Leveraging Hierarchical Deep Semantics to Classify Implicit Discourse Relations via Mutual Learning Method
نویسندگان
چکیده
This paper presents a mutual learning method using hierarchical deep semantics for the classification of implicit discourse relations in English. With the absence of explicit discourse markers, traditional discourse techniques mainly concentrate on discrete linguistic features in this task, which always leads to data sparse problem. To relieve this problem, we propose a mutual learning neural model which makes use of multilevel semantic information together, including the distribution of implicit discourse relations, the semantics of arguments and the co-occurrence of words. During the training process, the predicted target of the model which is the probability of the discourse relation type, and the distributed representation of semantic components are learnt jointly and optimized mutually. The results of both binary and multiclass identification show that this method outperforms previous works since the mutual learning strategy can distinguish Expansion type from the others efficiently.
منابع مشابه
Role Semantics for Better Models of Implicit Discourse Relations
Predicting the structure of a discourse is challenging because relations between discourse segments are often implicit and thus hard to distinguish computationally. I extend previous work to classify implicit discourse relations by introducing a novel set of features on the level of semantic roles. My results demonstrate that such features are helpful, yielding results competitive with other fe...
متن کاملLinguistic Properties Matter for Implicit Discourse Relation Recognition: Combining Semantic Interaction, Topic Continuity and Attribution
Modern solutions for implicit discourse relation recognition largely build universal models to classify all of the different types of discourse relations. In contrast to such learning models, we build our model from first principles, analyzing the linguistic properties of the individual top-level Penn Discourse Treebank (PDTB) styled implicit discourse relations: Comparison, Contingency and Exp...
متن کاملPredicting Implicit Discourse Relation with Multi-view Modeling and Effective Representation Learning
Discourse relations between two text segments play an important role in many natural language processing (NLP) tasks. The connectives strongly indicate the sense of discourse relations, while in fact, there are no connectives in a large proportion of discourse relations, i.e., implicit discourse relations. The key for implicit relation prediction is to correctly model the semantics of the two d...
متن کاملTag-Enhanced Tree-Structured Neural Networks for Implicit Discourse Relation Classification
Identifying implicit discourse relations between text spans is a challenging task because it requires understanding the meaning of the text. To tackle this task, recent studies have tried several deep learning methods but few of them exploited the syntactic information. In this work, we explore the idea of incorporating syntactic parse tree into neural networks. Specifically, we employ the Tree...
متن کاملLearning better discourse representation for implicit discourse relation recognition via attention networks
Humans comprehend the meanings and relations of discourses heavily relying on their semantic memory that encodes general knowledge about concepts and facts. Inspired by this, we propose a neural recognizer for implicit discourse relation analysis, which builds upon a semantic memory that stores knowledge in a distributed fashion. We refer to this recognizer as SeMDER. Starting from word embeddi...
متن کامل